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In this paper, we propose a Generalized Froggatt-Nielsen mechanism in which non-renormalizable operators 
involving a GUT group and U{1)h non-singlet Higgs field are introduced. Thus the GUT gauge symmetry 
breaking and the generation of hierarchical flavor hierarchy have a common origin in this mechanism. In this 
Generalized Froggatt-Nielsen mechanism, we propose universality conditions for coefficients corresponding to 
different contractions in the group productions. We find that the predictions in Generalized Froggatt-Nielsen 
mechanism for SU(5) GUT is different to that of ordinary Froggatt-Nielsen mechanism. Such Generalized 
Froggatt-Nielsen mechanism can be used in GUT models when ordinary Froggatt-Nielsen mechanism is no 
longer available. We study the application of Generalized Froggatt-Nielsen mechanism in SO(IO) model. We 
find that realistic standard model mass hierarchy and mixings can be obtained both in SU(5) and SO(IO) 
GUT models with such Generalized Froggatt-Nielsen mechanism. 

PACS numbers: Valid FAGS appear here 
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I. INTRODUCTION 

The standard model (SM) of electroweak interactions, 
based on the spontaneously broken SU{2)l x U{1)y 
gauge symmetry, has been extremely successful in de- 
scribing phenomena below the weak scale. One of the 
longstanding puzzles of the standard model is the dis- 
tinct pattern of masses and mixing for the quarks and 
leptons which appear to be hierarchical in different gen- 
erations. Froggatt-Nielsen mechanism^ is an elegant so- 
lution to such puzzles in which standard model renor- 
malizable yukawa couplings are the low energy effective 
interactions of certain high energy non-renormalizable in- 
teractions with U{1)h horizontal symmetry between dif- 
ferent generations. 

The approximately unification of the SU{3)c x 
SU{2)l X U{1)y gauge couplings strongly suggests the 
existence of a Grand Unified Theory (GUT). Grand Uni- 
fication Theory, such as the S'C/(5)^ and S'O(IO)^ models, 
give us deep insights into the problems of the standard 
model such as charge quantization, the origin of many 
free parameters, the standard model fermion masses and 
mixings, and beyond. In order to interpret the hierar- 
chical standard model flavor structure, it is possible to 
use Froggatt-Nielsen mechanism in GUT models which 
is very predictive due to the unification of the standard 
model matter contents. However, the applications of or- 
dinary Froggatt-Nielsen mechanism in GUT models are 
limited because it is very hard to get the realistic stan- 
dard model hierarchy structure in many GUT models. 

In ordinary Froggatt-Nielsen mechanism, renormaliz- 
able standard model yukawa couplings are not invari- 
ant under horizontal U{1)h gauge symmetry. One intro- 
duce the standard model gauge singlet Higgs field with 
non-trivial U{1)h quantum number to break the U{1)h 



horizontal symmetry which, after acquiring VEVs, can 
give rise to hierarchical standard model yukawa couplings 
from the high energy non-renormalizable U(1)h invari- 
ant Lagrangian. In GUT models, there are alternative 
possibilities in which we use certain high dimensional 
representation Higgs fields to break the GUT group as 
well as the U{1)h horizontal symmetry. Standard Model 
yukawa couplings can again be regarded as the low energy 
effective interactions of some high energy U{1)h invariant 
non-renormalizable interactions. This approach provides 
an unified point of view for both the GUT symmetry 
breaking and the generating of the flavor structure. We 
regard this approach as the Generalized Froggatt-Nielsen 
mechanism. 

This paper is organized as follows. In sec-HIl we dis- 
cuss the Generalized Froggatt-Nielsen mechanism and its 
applications in SU(5) GUT models. In sec- IIII[ we study 
the application of Generalized Froggatt-Nielsen mecha- 
nism in 4D SO(IO) model and the generations of realistic 
standard model mass hierarchy with the simplest form 
for yukawa coupling. Sec- II VI contains our discussions and 
conclusions. 



II. GENERALIZE FROGGATT-NIELSEN MECHANISM 
IN SU(5) MODEL 

It is well known that the SM fermion masses and mix- 
ings exhibit a hierarchical structure. The quark GKM 
mixings can be cast in the Wolfenstein formalism as^ 
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where A is of order 1 while p and rj are between A and 1. 
The hierarchy is reflected in the dependence of various 
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entries on different powers of A « 0.22. Renormalization 
group equation (RGE) running of the charged fermion 
masses to a high scale (~ 10^^ GeV) also reveals the 
following hierarchical structure 
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with TOfc /mt = A'^ . Grand Unification Theory which pre- 
dicts the unification of matter contents should also ex- 
plain the standard model hierarchical structure. So it 
is natural to think about the applications of Froggatt- 
Nielsen mechanism to GUT models. Ordinary Froggatt- 
Nielsen mechanism can be used in SU(5) GUT to get the 
desired flavor structure. 

In ordinary Froggatt- Nielsen mechanism, the standard 
model gauge singlet Higgs held with non-trivial U{1)h 
charge is introduced. In SU(5) GUT model, the U{1)h 
gauge invariant non-renormalizable Lagrangian is intro- 
duced 



g \ (Q'w+Qio+Qii) 
MJ 
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with some new physics energy scale M and the U{1)h 
charge Q{S) = -1. After the GUT singlet Higgs field S 
acquires a Vacuum Expectation Values < S" > to break 
the U(1)h horizontal gauge symmetry, the hierarchical 
standard model yukawa couplings are obtained. 

For example, we can get the flavor structure by assign- 
ing the U{1)h charge 



Q{Flo) = 4, Q{Fl^) = 2 ,Q{Fl^) = 0, 

Q(/b)-o, q(/|) = o, g(/l) = o, 

Q{H) = , 
to get the realistic mass ratio in ^ with 
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However, it is difficult to apply this ordinary Froggatt- 
Nielsen mechanism in other 4D GUT models. For ex- 
ample, we can not get realistic mass hierarchy in SO (10) 
GUT models with simplest yukawa coupling term when 
ordinary Froggatt-Nielsen mechanism is used. In this 
paper, we propose a Generalized Froggatt-Nielsen mech- 
anism to solve such difficulties. 

In our approach, the GUT group non-singlet Higgs 
fields $ with non-trivial horizontal U{1)h charge is in- 
troduced. By assigning proper U{1)h quantum numbers 
to SU(5) matter contents F^q and /| , we can get the 



gauge invariant non-renormalizable Lagrangian 
(Qlo+<3io+<3H) 
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with the index s,i denote the different group production 
contractions and the U{1)h charge Q($) = —1. The co- 
efficients Qffj and /3*^- which corresponds to different con- 
tractions in the group production are 0(1) parameters. 
The group production of such GUT group non-singlet 
Higgs fields will give various non-renormalizable opera- 
tors, including terms that appear in ordinary Froggatt- 
Nielsen mechanism. As there are many types of contrac- 
tions in the group production, the most naturally choice 
for the corresponding coefficients is by assuming their 
universality 
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The adjoint Higgs can acquire Vacuum Expectation Val- 
ues (VEVs) to break the SU(5) GUT gauge group into 
SU{?,)c X SU{2)l X U{1)y. Such VEVs can be written 
in terms of 5 x 5 matrix 



< $24 >= Wo 
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with normalization factor c = i as well as 10 x 10 matrix 



< $24 >= WOI 



5diag(-, 
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with normalization factor c = | . 

The predictions of generalized Froggatt-Nielsen mech- 
anism in SU(5) GUT is different to that of ordinary 
Froggatt-Nielsen mechanism. The mass matrix for up- 
type quarks can be calculated to be 

(i^)°^' + (-^)"^' (§^r'' + (-^r'' (§^r=' + i 
\{w^{rW ii^r' + i-i^r' (f-)"^^ + (-^)° 



which after simplification 
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will give the mass hierarchy 
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Here we use the notation 
A = 
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and the definition 

ai^[U]=Q[Ui]+Q[{Uiy] 
We can chose 



Q[10'] + Q[\&] . (15) 



with 



Q[10^] = 2, Q[102] = 1 , Q[103] = , (16) 



^Af« (0.22)2, (^y-j 



to get the reahstic mass hierarchy for up-type quarks. 

Similarly, we can caculate the mass matrix for down- 
type quarks 



and charged leptons 
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with the definition 

bij[D] = bij[E] = Q[10'] + Q[5^ 
After simplification, they will give 
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Then we can get approximately the realistic mass hier- 
archy for down-type quarks and charged leptons 
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with the U{1)h charge assignment 

g[5i] =0, Q[5'] =0 ,Q[53] =0 
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The mixing matrix can be easily obtained from the mass 
matrix and we will not give the expressions here. 

We can also use 75, 200, • • • dimensional represen- 
tation fields as $ to construct the non-renormalizable 
terms. For example, the VEVs of 75 dimensional repre- 
sentations can be written as 10 x 10 matrix 



< *75 > = 



2\/3 



diag( I,-- - , 1,-1, 



-l,-3),(23) 



with normalization factor c = |. Constructing Gener- 
alized Froggatt-Nielsen type non-normalizable terms in- 
vovling <I)75 and assuming universality for the coefficients 
corresponding to different contractions in the group pro- 
duction, we can obtain the mass hierarchy for standard 
model fermions 
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Again, we can get approximately the realistic mass hier- 
archy by assigning the U{1)h charge 



Q[10^] =2, 0[102] = 1 ,Q[10^] = 
Q[5^] = 0, Q[52] =0 ,Q[53] =0 







(28) 



III. GENERALIZE FROGGATT-NIELSEN MECHANISM 
IN SO(IO) MODEL 

SO (10) GUT model is very predictive not only be- 
cause its genuine unification of all the standard model 
gauge couplings but also because all the standard model 
matter contents within each generation can be filled into 
one 16 dimensional spinor representation. Due to its 
highly predictive nature (very few parameters) , ordinary 
Froggatt-Nielsen mechanism can not be used in such 4D 
SO(IO) GUT models to give the realistic standard model 
flavor structure. However, it is possible to use Gener- 
afized Froggatt-Nielsen mechanism in 4D SO(IO) GUT 
models to obtain the realistic hierarchical flavor struc- 
ture. We consider the following U{1)h invariant non- 
renormalizable Lagrangian 



(Qie+Qie+QH) 
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Again, the coefficients yfj which correspond to different 
contractions in the group production are 0(1) parame- 
ters. We also assume universality for each coefficients 
that corresponds to different contractions 
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The VEVs of 45 dimensional representation Higgs 
can break the SO(IO) GUT model into Georgi-Glashow 
SU{5) X U{1) model, flipped SU(5) model etc. As an 
example, we consider the symmetry breaking chain into 
Georgi-Glashow SU{5) x [7(1) model. The VEVs of 
45 dimensional representation Higgs can be written as 
16 X 16 matrix 
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with normalization factor c = 2. After calculations, we 
can obtain the prediction for the standard model mass 
hierarchy 
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We can get approximately the realistic mass hierarchy of 
standard model fermions by the U{1)h assignment 

Q[16'] = 3, Q[W^] = I Q[163] = 0, (37) 



with the choice 



A w (0.22) 



(38) 



We can see that realistic standard model mass and mixing 
hierarchy can be obtained in SO(IO) GUT model even 
with the simplest choice of yukawa coupling. Thus we 
can see the advantage of Generalized Froggatt-Nielsen 
mechanism over ordinary Froggatt-Nielsen mechanism in 
obtaining the standard model flavor structure in GUT 
models. 



We find that the predictions in Generalized Froggatt- 
Nielsen mechanism for SU(5) GUT is different to that 
of ordinary Froggatt-Nielsen mechanism. Such General- 
ized Froggatt-Nielsen mechanism can be used in GUT 
models when ordinary Froggatt-Nielsen mechanism is no 
longer available. We study the applications of General- 
ized Froggatt-Nielsen mechanism in SO(IO) models. We 
find that realistic standard model mass hierarchy and 
mixings can be obtained both in SU(5) and SO(IO) GUT 
models with such Generalized Froggatt-Nielsen mecha- 
nism. 

It is also possible to abandon the universality condi- 
tions for coefficients corresponding to different contrac- 
tions in the group productions. Then we can specify the 
desired representations from and calculating the cor- 
responding Glebsch- Gordon coefficients. This scenario 
is only natural in SUSY GUT models due to the non- 
renormalization theorem for superpotential'^ . The effects 
of non-renormalizable superpotential involving high di- 
mensional representation Higgs can be found in our pre- 
vious works^^— . We will discuss the scenario with non- 
universality conditions in our future works. 
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IV. CONCLUSIONS 

In this paper, we propose a Generalized Froggatt- 
Nielsen mechanism in which non-renormalizable opera- 
tors involving a GUT group and U{1)h non-singlet Higgs 
field are introduced. Thus the GUT gauge symmetry 
breaking and the generation of hierarchical flavor hi- 
erarchy have a common origin in this mechanism. In 
this Generalized Froggatt-Nielsen mechanism, we pro- 
pose universality conditions for coefficients correspond- 
ing to different contractions in the group productions. 
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